Net Risk Reclassification P Values: Valid or Misleading?

Net risk reclassification p values: valid or misleading?

BACKGROUND The Net Reclassification Index (NRI) and its P value are used to make conclusions about improvements in prediction performance gained by adding a set of biomarkers to an existing risk prediction model. Although proposed only 5 years ago, the NRI has gained enormous traction in the risk prediction literature. Concerns have recently been raised about the statistical validity of the NRI...

Net Reclassification Index: a Misleading Measure of Prediction Improvement

P - values : Democrats or Dictators ?

Part of being a good analyst and statistician is being able to understand the output of a statistical test in SAS ® . Pvalues are ubiquitous in statistical output as well as medical literature and can be the deciding factor in whether a paper gets published. This shows a somewhat dictatorial side of them. But do we really know what they mean? In a democratic process, people vote for another per...

Net reclassification indices for evaluating risk prediction instruments: a critical review.

Net reclassification indices have recently become popular statistics for measuring the prediction increment of new biomarkers. We review the various types of net reclassification indices and their correct interpretations. We evaluate the advantages and disadvantages of quantifying the prediction increment with these indices. For predefined risk categories, we relate net reclassification indices...

What Size Net Gives Valid Generalization?

We address the question of when a network can be expected to generalize from m random training examples chosen from some arbitrary probability distribution, assuming that future test examples are drawn from the same distribution. Among our results are the following bounds on appropriate sample vs, network size. Assume 0 < E 5 1/8. We show that if m 2 0($209!) random examples can be loaded on a ...